篇首语：本文由编程笔记#小编为大家整理，主要介绍了直播技术（从服务端到客户端）一相关的知识，希望对你有一定的参考价值。
2015年开始直播变得越来越流行&＃xff0c;很多的直播平台也应运而生&＃xff0c;直播是一个很有技术的项目&＃xff0c;从服务端到客户端到web等等。我们将写一序列的博客来阐述直播中的技术&＃xff0c;这包括服务端技术和客户端技术。包括最简单的服务端环境部署、客户端编译、采集、推流、拉流、美化特效、水印、延时优化、音视频同步、p2p等等。当然还可能包括一些信号处理的知识&＃xff0c;比如滤波&＃xff0c;傅里叶变换&＃xff08;FFT&＃xff09;。从本文开始我们将从环境部署开始&＃xff0c;这包括两方面的环境部署即服务端和客户端。
在部署服务端环境其实包含很多东西的&＃xff0c;最常用的web服务nginx&＃xff0c;数据库mysql、Nosql&＃xff0c;api开发最多的三种选择&＃xff1a;
考虑使用缓存技术&＃xff0c;则主要包含redis和memcached。如果还要其他的日志统计&＃xff08;kafka什么的&＃xff09;需求则还需要更多的环境&＃xff0c;我们这里不讨论&＃xff0c;只是简单叙述
对于直播而言&＃xff0c;我们需要部署两个东西&＃xff0c;nginx(含nginx-rtmp-module)、ffmpeg&＃xff0c;这两个是直播服务端的关键&＃xff0c;下面我们简单讲述如何安装nginx(含nginx-rtmp-module)和ffmpeg以及如何配置nginx.conf。
首选我们来安装nginx和ffmpeg。
nginx下载地址&＃xff1a;
ffmpeg下载地址&＃xff1a;
nginx-rtmp-module下载地址&＃xff1a;https://github.com/arut/nginx-rtmp-module
其中nginx-rtmp-module是Google工程师开发的&＃xff0c;在gitHub上有很多分支&＃xff0c;根据自己的需求选择分支&＃xff0c;我们这里选择master分支。
首选安装nginx和nginx-rtmp-module&＃xff0c;在安装nginx的时候&＃xff0c;会需要openssl、pcre、zlib这几个库。cd 进入nginx解压目录
./configure --prefix&＃61;/usr/local/nginx --with-pcre&＃61;/path/to/your/pcre/ --with-zlib&＃61;/path/to/your/zlib/ --with-openssl&＃61;/path/to/your/openssl/ --add-module&＃61;/path/to/your/nginx-rtmp-module
其中–prefix是指安装后nginx的目录&＃xff0c;–with-pcre需要pcre库&＃xff0c;/path/to/your/pcre/是指的pcre源代码路径&＃xff0c;其他的同理。–add-module&＃61;/path/to/your/nginx-rtmp-module 这个是添加nginx-rtmp-module&＃xff0c;将nginx-rtmp-module嵌入到nginx中&＃xff0c;这样是nginx的强大之处-插件功能。
安装完成之后&＃xff0c;在浏览器中输入localhost:8080则会出现如下画面&＃xff1a;
那么接下安装ffmpeg&＃xff0c;解压ffmpeg并cd进去目录&＃xff0c;执以下语句
./configure --enable-shared --prefix&＃61;/usr/local/ffmpeg
网上有很多安装ffmpeg的教程&＃xff0c;这里不详细介绍。
如果安装成功后会&＃xff0c;在终端中输入 ffmpeg -version会显示相关的信息。如果没有则可能没有安装成功。
安装完成之后我们来看看nginx.conf的配置信息。
worker_processes 2;
error_log logs/error.log;
error_log logs/error.log notice;
error_log logs/error.log info;
pid logs/nginx.pid;
events
worker_connections 128;
http
include mime.types;
default_type application/octet-stream;
log_format main &＃39;$remote_addr - $remote_user [$time_local] "$request" &＃39;
&＃39;$status $body_bytes_sent "$http_referer" &＃39;
&＃39;"$http_user_agent" "$http_x_forwarded_for"&＃39;;
access_log logs/access.log main;
sendfile on;
keepalive_timeout 65;
server_names_hash_bucket_size 128;
client_header_buffer_size 32k;
large_client_header_buffers 4 32k;
client_max_body_size 300m;
tcp_nopush on;
tcp_nodelay on;
server_tokens off;
gzip on;
gzip_min_length 1k;
gzip_buffers 4 16k;
gzip_http_version 1.1;
gzip_comp_level 2;
gzip_types text/plain application/x-Javascript text/css application/xml;
gzip_vary on;
include vhosts/*.conf;
#切换自动推送(多 worker 直播流)模式。默认为 off
#rtmp_auto_push on;
#当 worker 被干掉时设置自动推送连接超时时间。默认为 100 毫秒
#rtmp_auto_push_reconnect 1s;
#设置用于流推送的 UNIX 域套接字目录。默认为 /tmp
#rtmp_socket_dir /var/sock;
rtmp
server
listen 1935;
#点播配置
#application vod
# play /opt/media/nginxrtmp/flv;
#
#直播流配置
application live
live on;
#allow publish 127.0.0.1;
#deny publish all;
#allow play all;
#access_log logs/rtmp_access.log new;
access_log logs/rtmp_access.log;
access_log on;
#HLS协议支持
#application hls
#live on;
#hls on;
#hls_path /tmp/app;
#hls_fragment 5s;
#
#application hls
# live on;
# hls on;
# hls_path /usr/local/Cellar/nginx-full/1.10.1/html/app;
# hls_fragment 1s;
#
其中http相关的标签我这边不做详细的介绍&＃xff0c;这个等一会用到api的时候详细介绍。下面我们看看rtmp标签&＃xff0c;rtmp标签的意思是声明一个 RTMP 实例。在rtmp标签下面有server&＃xff0c;它的意思是给 NGINX 添加一个监听端口以接收 RTMP 连接
application标签是创建一个 RTMP 应用。application 名的模式并不类似于 http location。这个以后再详细阐述。在这个配置中&＃xff0c;我们只是配置了一个live&＃xff0c;同时打开了log&＃xff0c;其他的相关的参数我们现在不说明&＃xff0c;等以后会专门介绍rtmp的配置文章介绍。
配置好了这个之后就是通过ffmpeg向server推流。ffmpeg的指令为&＃xff1a;
ffmpeg -re -i /Users/jarlene/Downloads/test.flv -c copy -f flv rtmp://localhost:1935/live/steam
这里不详细介绍ffmpeg指令&＃xff0c;因为接下来我们会有一篇专门的文章接受ffmpeg。
这个时候就可以用vlc播放器拉流看直播了。
到这里我们就简单讲述了nginx和ffmpeg安装和nginx.conf配置信息以及推流和观看
相对于服务端环境部署来说客户端环境部署复杂很多&＃xff0c;尤其是在android平台&＃xff0c;编译导入android studio等等过程都很复杂&＃xff0c;ios平台还好&＃xff0c;但是由于我个人喜爱&＃xff0c;在此也会加上Windows客户端相配置&＃xff0c;只不过windows会一段时间后更新。对于客户端主要就是编译ffmpeg。下面这段脚本是编译ffmpeg到android和ios平台的。
#/bin/bash
AndroidDest&＃61;&＃96;pwd&＃96;/FFmpeg-Android && rm -rf $AndroidDest
IOSDest&＃61;&＃96;pwd&＃96;/FFmpeg-iOS && rm -rf $IOSDest
SOURCE&＃61;"ffmpeg-3.1.1"
THIN&＃61;"$IOSDest/thin"
SCRATCH&＃61;"$IOSDest/scratch"
echo $THIN
echo $SCRATCH
# if [ -d ffmpeg ]; then
# cd ffmpeg
# else
# git clone git://source.ffmpeg.org/ffmpeg.git ffmpeg
# cd ffmpeg
# fi
if [ ! -r $SOURCE ]
then
echo &＃39;FFmpeg source not found. Trying to download...&＃39;
curl http://www.ffmpeg.org/releases/$SOURCE.tar.bz2 | tar xj \\
|| exit 1
fi
function android()
cd $SOURCE
# sed -i -e &＃39;s|SLIBNAME_WITH_MAJOR&＃61;&＃39;\\$(SLIBNAME).\\$(LIBMAJOR)&＃39;|SLIBNAME_WITH_MAJOR&＃61;&＃39;\\$(SLIBPREF)\\$(FULLNAME)-\\$(LIBMAJOR)\\$(SLIBSUF)&＃39;|&＃39; configure
# sed -i -e &＃39;s|LIB_INSTALL_EXTRA_CMD&＃61;&＃39;\\$\\$(RANLIB)"\\$(LIBDIR)/\\$(LIBNAME)"&＃39;|LIB_INSTALL_EXTRA_CMD&＃61;&＃39;\\$\\$(RANLIB)"\\$(LIBDIR)/\\$(LIBNAME)"&＃39;|&＃39; configure
# sed -i -e &＃39;s|SLIB_INSTALL_LINKS&＃61;&＃39;\\$(SLIBNAME_WITH_MAJOR)\\$(SLIBNAME)&＃39;|SLIB_INSTALL_LINKS&＃61;&＃39;\\$(SLIBNAME)&＃39;|&＃39; configure
NDK&＃61;/Users/jarlene/Library/Android/sdk/ndk-bundle
SYSROOT&＃61;$NDK/platforms/android-19/arch-arm
WORKING_DIR&＃61;&＃96;pwd&＃96;
# Expand the prebuilt/* path into the correct one
TOOLCHAIN&＃61;&＃96;echo $NDK/toolchains/arm-linux-androideabi-4.9/prebuilt/darwin-x86_64&＃96;
export PATH&＃61;$TOOLCHAIN/bin:$PATH
# Don&＃39;t build any neon version for now
for version in armv5te armv7a; do
DEST&＃61;$AndroidDest
FLAGS&＃61;"--target-os&＃61;linux --cross-prefix&＃61;arm-linux-androideabi- --arch&＃61;arm"
FLAGS&＃61;"$FLAGS --sysroot&＃61;$SYSROOT"
#FLAGS&＃61;"$FLAGS --soname-prefix&＃61;/data/data/net.sourceforge.servestream/lib/"
FLAGS&＃61;"$FLAGS --enable-shared --disable-symver"
# FLAGS&＃61;"$FLAGS --enable-small --optimization-flags&＃61;-O2"
#FLAGS&＃61;"$FLAGS --extra-cflags&＃61;-I$NDK/platforms/android-23/arch-arm/usr/include/ffmpeg --extra-ldflags&＃61;-L$NDK/platforms/android-23/arch-arm/usr/lib"
FLAGS&＃61;"$FLAGS --disable-doc"
# FLAGS&＃61;"$FLAGS --enable-gpl"
FLAGS&＃61;"$FLAGS --disable-ffmpeg"
FLAGS&＃61;"$FLAGS --disable-ffplay"
FLAGS&＃61;"$FLAGS --disable-ffprobe"
FLAGS&＃61;"$FLAGS --disable-ffserver"
# FLAGS&＃61;"$FLAGS --enable-avdevice"
# FLAGS&＃61;"$FLAGS --enable-swresample"
# FLAGS&＃61;"$FLAGS --enable-swscale"
FLAGS&＃61;"$FLAGS --enable-postproc"
# FLAGS&＃61;"$FLAGS --enable-avfilter"
# FLAGS&＃61;"$FLAGS --disable-everything"
# FLAGS&＃61;"$FLAGS --enable-muxer&＃61;mov --enable-muxer&＃61;ipod --enable-muxer&＃61;psp --enable-muxer&＃61;mp4 --enable-muxer&＃61;avi "
# FLAGS&＃61;"$FLAGS --enable-demuxer&＃61;acc,flac,h263,h264,m4v,matroska,mp3,mpegvideo,ogg,pcm_alaw,pcm_f32be,pcm_f32le,pcm_f64be,pcm_f64le,pcm_mulaw,pcm_s16be,pcm_s16le,pcm_s24be"
# FLAGS&＃61;"$FLAGS --enable-demuxer&＃61;pcm_s24le,pcm_s32be,pcm_s32le,pcm_s8,pcm_u16be,pcm_u16le,pcm_u24be,pcm_u24le,pcm_u32be,pcm_u32le,pcm_u8,rtp,rtsp,sdp,wav"
# FLAGS&＃61;"$FLAGS --enable-parser&＃61;aac,aac_latm,flac,h263,h264,mpeg4video,mpegaudio,mpegvideo,vorbis,vp8"
# FLAGS&＃61;"$FLAGS --enable-decoder&＃61;aac,aac_latm,mp3,wmalossless,wmapro,wmav1,wmav2,wmavoice,mpeg4,h264"
# FLAGS&＃61;"$FLAGS --enable-protocol&＃61;http,https,mmsh,mmst,rtmp,hls,file,rtsp"
FLAGS&＃61;"$FLAGS --disable-debug"
case "$version" in
neon)
EXTRA_CFLAGS&＃61;"-march&＃61;armv7-a -mfloat-abi&＃61;softfp -mfpu&＃61;neon"
EXTRA_LDFLAGS&＃61;"-Wl,--fix-cortex-a8"
# Runtime choosing neon vs non-neon requires
# renamed files
ABI&＃61;"armeabi-v7a"
;;
armv7a)
EXTRA_CFLAGS&＃61;"-march&＃61;armv7-a -mfloat-abi&＃61;softfp"
EXTRA_LDFLAGS&＃61;""
ABI&＃61;"armeabi-v7a"
;;
*)
EXTRA_CFLAGS&＃61;""
EXTRA_LDFLAGS&＃61;""
ABI&＃61;"armeabi"
;;
esac
DEST&＃61;"$DEST/$ABI"
FLAGS&＃61;"$FLAGS --prefix&＃61;$DEST"
mkdir -p $DEST
echo $FLAGS --extra-cflags&＃61;"$EXTRA_CFLAGS" --extra-ldflags&＃61;"$EXTRA_LDFLAGS" > $DEST/info.txt
./configure $FLAGS --extra-cflags&＃61;"$EXTRA_CFLAGS" --extra-ldflags&＃61;"$EXTRA_LDFLAGS" | tee $DEST/configuration.txt
[ $PIPESTATUS &＃61;&＃61; 0 ] || exit 1
make clean
make -j4 || exit 1
make install || exit 1
done
cd ..
function ios()
mkdir -p $IOSDest
CONFIGURE_FLAGS&＃61;"--enable-cross-compile --disable-debug --disable-programs \\
--disable-doc --enable-pic"
if [ "$X264" ]
then
CONFIGURE_FLAGS&＃61;"$CONFIGURE_FLAGS --enable-gpl --enable-libx264"
fi
if [ "$FDK_AAC" ]
then
CONFIGURE_FLAGS&＃61;"$CONFIGURE_FLAGS --enable-libfdk-aac"
fi
# avresample
#CONFIGURE_FLAGS&＃61;"$CONFIGURE_FLAGS --enable-avresample"
# arm64 armv7 x86_64 i386
ARCHS&＃61;"arm64 armv7 x86_64"
COMPILE&＃61;"y"
LIPO&＃61;"y"
DEPLOYMENT_TARGET&＃61;"6.0"
if [ "$*" ]
then
if [ "$*" &＃61; "lipo" ]
then
# skip compile
COMPILE&＃61;
else
ARCHS&＃61;"$*"
if [ $# -eq 1 ]
then
# skip lipo
LIPO&＃61;
fi
fi
fi
if [ "$COMPILE" ]
then
if [ ! &＃96;which yasm&＃96; ]
then
echo &＃39;Yasm not found&＃39;
if [ ! &＃96;which brew&＃96; ]
then
echo &＃39;Homebrew not found. Trying to install...&＃39;
ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)" \\
|| exit 1
fi
echo &＃39;Trying to install Yasm...&＃39;
brew install yasm || exit 1
fi
if [ ! &＃96;which gas-preprocessor.pl&＃96; ]
then
echo &＃39;gas-preprocessor.pl not found. Trying to install...&＃39;
(curl -L https://github.com/libav/gas-preprocessor/raw/master/gas-preprocessor.pl \\
-o /usr/local/bin/gas-preprocessor.pl \\
&& chmod &＃43;x /usr/local/bin/gas-preprocessor.pl) \\
|| exit 1
fi
# if [ ! -r $SOURCE ]
# then
# echo &＃39;FFmpeg source not found. Trying to download...&＃39;
# curl http://www.ffmpeg.org/releases/$SOURCE.tar.bz2 | tar xj \\
# || exit 1
# fi
cd $SOURCE
configHeaderFile&＃61;"$SOURCE/config.h"
make clean
if [ ! -f "$configHeaderFile" ]; then
# echo $configHeaderFile
rm config.h
fi
cd ..
CWD&＃61;&＃96;pwd&＃96;
echo $CWD
for ARCH in $ARCHS
do
echo "building $ARCH..."
mkdir -p "$SCRATCH/$ARCH"
cd "$SCRATCH/$ARCH"
CFLAGS&＃61;"-arch $ARCH"
if [ "$ARCH" &＃61; "i386" -o "$ARCH" &＃61; "x86_64" ]
then
PLATFORM&＃61;"iPhoneSimulator"
CFLAGS&＃61;"$CFLAGS -mios-simulator-version-min&＃61;$DEPLOYMENT_TARGET"
else
PLATFORM&＃61;"iPhoneOS"
CFLAGS&＃61;"$CFLAGS -mios-version-min&＃61;$DEPLOYMENT_TARGET -fembed-bitcode"
if [ "$ARCH" &＃61; "arm64" ]
then
EXPORT&＃61;"GASPP_FIX_XCODE5&＃61;1"
fi
fi
XCRUN_SDK&＃61;&＃96;echo $PLATFORM | tr &＃39;[:upper:]&＃39; &＃39;[:lower:]&＃39;&＃96;
CC&＃61;"xcrun -sdk $XCRUN_SDK clang"
CXXFLAGS&＃61;"$CFLAGS"
LDFLAGS&＃61;"$CFLAGS"
if [ "$X264" ]
then
CFLAGS&＃61;"$CFLAGS -I$X264/include"
LDFLAGS&＃61;"$LDFLAGS -L$X264/lib"
fi
if [ "$FDK_AAC" ]
then
CFLAGS&＃61;"$CFLAGS -I$FDK_AAC/include"
LDFLAGS&＃61;"$LDFLAGS -L$FDK_AAC/lib"
fi
TMPDIR&＃61;$TMPDIR/%\\/ $CWD/$SOURCE/configure \\
--target-os&＃61;darwin \\
--arch&＃61;$ARCH \\
--cc&＃61;"$CC" \\
$CONFIGURE_FLAGS \\
--extra-cflags&＃61;"$CFLAGS" \\
--extra-ldflags&＃61;"$LDFLAGS" \\
--prefix&＃61;"$THIN/$ARCH" \\
|| exit 1
make -j3 install $EXPORT || exit 1
cd $CWD
done
fi
if [ "$LIPO" ]
then
echo "building fat binaries..."
mkdir -p $IOSDest/lib
set - $ARCHS
CWD&＃61;&＃96;pwd&＃96;
cd $THIN/$1/lib
for LIB in *.a
do
cd $CWD
echo lipo -create &＃96;find $THIN -name $LIB&＃96; -output $IOSDest/lib/$LIB 1>&2
lipo -create &＃96;find $THIN -name $LIB&＃96; -output $IOSDest/lib/$LIB || exit 1
done
cd $CWD
cp -rf $THIN/$1/include $IOSDest
fi
echo Done
ios
android
这段脚本可以编译出android和ios的两个平台的配置&＃xff0c;当然根据你的需求在configure中配置需要的东西&＃xff0c;否则ffmpeg编译出来之后还是很大。
顺便解释一下&＃xff1a;SOURCE&＃61;”ffmpeg-3.1.1”这个是release ffmpeg的版本&＃xff0c;通过curl去下载&＃xff0c;然后会在脚本的目录出下载并解压生成一个ffmpeg-3.1.1目录。
这个脚本有两个事情需要说明&＃xff1a;
将下面的内容
SLIBNAME_WITH_MAJOR&＃61;&＃39;$(SLIBNAME).$(LIBMAJOR)&＃39;
LIB_INSTALL_EXTRA_CMD&＃61;&＃39;$$(RANLIB) "$(LIBDIR)/$(LIBNAME)"&＃39;
SLIB_INSTALL_NAME&＃61;&＃39;$(SLIBNAME_WITH_VERSION)&＃39;
SLIB_INSTALL_LINKS&＃61;&＃39;$(SLIBNAME_WITH_MAJOR) $(SLIBNAME)&＃39;
修改为&＃xff1a;
SLIBNAME_WITH_MAJOR&＃61;&＃39;$(SLIBPREF)$(FULLNAME)-$(LIBMAJOR)$(SLIBSUF)&＃39;
LIB_INSTALL_EXTRA_CMD&＃61;&＃39;$$(RANLIB) "$(LIBDIR)/$(LIBNAME)"&＃39;
SLIB_INSTALL_NAME&＃61;&＃39;$(SLIBNAME_WITH_MAJOR)&＃39;
SLIB_INSTALL_LINKS&＃61;&＃39;$(SLIBNAME)&＃39;
当然如果你是shell脚本高手&＃xff0c;在编译android的时候通过sed命令将上面提到内容进行修改也是可以的。
编译完成之后将编译出来的lib&＃xff08;so文件或者.a文件&＃xff09;和include&＃xff08;头文件&＃xff09;拷贝到你android studio中和xcode中。android具体如图&＃xff1a;
gradle脚本配置&＃xff1a;
ndk
moduleName "FFPlayer"
stl "stlport_static"
cFlags "-std&＃61;gnu&＃43;&＃43;11 -DGL_GLEXT_PROTOTYPES"
abiFilters "armeabi", "armeabi-v7a"
String basePath &＃61; new File("./").canonicalPath &＃43; "/ffplaylib/src/main/jniLibs/armeabi/"
String libavcodec &＃61; basePath &＃43; "libavcodec-54.so"
String libavdevice &＃61; basePath &＃43; "libavdevice-54.so"
String libavfilter &＃61; basePath &＃43; "libavfilter-3.so"
String libavformat &＃61; basePath &＃43; "libavformat-54.so"
String libavutil &＃61; basePath &＃43; "libavutil-51.so"
String libswresample &＃61; basePath &＃43; "libswresample-0.so"
String libswscale &＃61; basePath &＃43; "libswscale-2.so"
ldLibs "log","GLESv2","dl", "GLESv1_CM","GLESv2", "android",libavcodec, libavdevice, libavfilter, libavformat, libavutil,libswresample,libswscale
sourceSets
main
jni.srcDirs "src/main/jni", "src/main/jni/include","src/main/jni/include/libavcodec","src/main/jni/include/libavdevice","src/main/jni/include/libavfilter",
"src/main/jni/include/libavformat","src/main/jni/include/libavutil","src/main/jni/include/libswresample",
"src/main/jni/include/libswscale", "src/main/jni/SDL", "src/main/jni/SDL/include"
jniLibs.srcDirs "src/main/jinLibs"
第一个是ndk配置&＃xff0c;配置moduleName等&＃xff0c;同时指定本地依赖libavcodec等so库。
sourceSets主要是制定include头文件路径。
这样就能移植进入android studio中&＃xff0c;而不是在eclipse中。
而对ios想到简单一些。具体如图&＃xff1a;
因为这边是用swift写的应用&＃xff0c;所以还需要指定Swift compiler和Search path
Search path&＃xff1a;
Swift compiler
Swift compiler的头文件如下&＃xff1a;
做完这些之后就可以在代码中直接引用了。
在android中是通过jni调用Native代码的&＃xff0c;这里我就详细介绍了。
本文讲述从服务端到客户基本环境部署&＃xff0c;其中包括一些关键的东西点。下一篇直播技术的文章将阐述android和ios如何播放视频代码。再之后将会详细介绍ffmpeg以及其基本架构。之后会叙述服务端nginx.conf基本配置以及客户端采集推流相关的东西。
京公网安备 11010802041100号 | 京ICP备19059560号-4 | PHP1.CN 第一PHP社区 版权所有 